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Abstract 


This study investigates students' perceptions of classroom assessment tasks as a function of gender, 
subject area, and grade level. Data from 2753 students on Dorman and Knightley's (2006) Perceptions of 
Assessment Tasks Inventory (PATI) were analyzed in a MANOVA design. Results showed that students 
tended to hold positive perceptions of their classroom assessment tasks in terms of congruence with 
planned learning, authenticity, student consultation, transparency, and diversity. There were statistically 
significant 3-way interaction effects for gender, subject area, and grade level on congruence with planned 
learning and transparency. Also, there were statistically significant 2-way interaction effects for gender 
and grade level on authenticity and student consultation. Further, there were statistically significant 2- 
way interaction effects for gender and subject area on student consultation and diversity. The 
implications of the results for classroom assessment as well as recommendations for future research were 
discussed. 
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1. Introduction 

Students' perceptions of the classroom assessment have received increased attention in the 
educational assessment research to determine their relationship to student motivation and 
learning (Black & Wiliam, 1998; Brookhart, 1997, 2013; Harlen & Crick, 2003). They provide 
educators another lens with which to improve the classroom assessment process (Cook-Sather, 
2002; Mullinix, 2001; Ryan, 2002). Indeed, it is students' perceptions of the classroom 
assessment that may influence their learning, not the assessment context in itself. It has been 
emphasized that effectiveness of the educational change depend on the change of the students' 
perceptions (Lawness & Richardson, 2002). Therefore, the investigation of these perceptions of 
assessment is important in understanding the learning process. Less researched, however, is 
how do students' perceptions of the classroom assessment tasks vary simultaneously as a 
function of gender, subject area, and grade level. It is reasonable to argue that these three 
factors may account for some variations in the perceptions of the assessment tasks. On one 
hand, this is due to the nature of the classroom assessment activities specific to the subject 
areas and grade levels. On the other hand, this is due to the well documented gender 
differences in learning-related perceptions and behaviors. As such, this study sought to expand 
the current research on students' perceptions of the classroom assessment by examining 
perceptions of the classroom assessment tasks in relation to gender, subject area, and grade 
level. These points provide the rationale for the present study. 

In an attempt to operationalize students' perceptions of assessment, Dorman and Knightley 
(2006) developed a 40-item Perceptions of Assessment Tasks Inventory (PATI) to measure 
students' perceptions of assessment tasks in terms of congruence with planned learning, 
authenticity, student consultation, transparency, and diversity. The PATI has been used in 
several research studies. For example, Dhindsa, Omar, and Waldrip (2007) found that secondary 
students in Brunei tended to hold weak positive perceptions of the classroom assessment tasks 
as measured by PATI. Also, Dhindsa et al. (2007) found statistically significant gender differences 
in perceived congruence with planned learning favoring females and perceived student 
consultation in assessment favoring males. Further, Dhindsa et al. (2007) showed statistically 
significant grade level differences in perceived congruence with planned learning and 
transparency in assessment favoring upper grades. They concluded that students' perceptions of 
assessment could be improved by enhancing teachers' practices. 

Gao (2012) found that classroom assessments in mathematics as perceived by high school 
students tended to have a strong congruence with instruction, adequate transparency, 
inadequate authenticity, little student consultation, and diversity. Statistically significant gender 
differences were found in assessment authenticity and transparency favoring females. Gao 
(2012) called for more research on students' perceptions of classroom assessment in other 
subject areas and grade levels. Alkharusi, Aldhafri, Alnabhani, and Alkalbani (2013b) found that 
students tended to hold positive perceptions of their classroom assessment tasks as measured 
by PATI. In addition, congruence with planned learning, student consultation, and transparency 
were significantly associated with students' academic achievement whereas authenticity and 
diversity did not contribute significantly to the variance explained in academic achievement. 
Alkharusi et al. (2013b) concluded that classroom assessment environment as perceived by 
students could contribute to student achievement-related outcomes. 

Research has also examined perceptions of assessment tasks in relation to students' 
motivational beliefs and study approaches. For example, Alkharusi et al. (2013a) found that 
students' perceptions of assessment tasks had direct and indirect effects on academic self- 
efficacy and perceptions of task value. Alkharusi et al. (2013a) concluded that teachers should 
develop assessment tasks in ways that activate students' sense of efficacy to accomplish the 
tasks and enhance their value of engaging in the tasks. Another study by Alkharusi (2013) found 
that although students' perceptions of assessment tasks and study approaches did not vary by 
gender; high degrees of authenticity, transparency, and diversity in assessment tasks tended to 
be associated with deep learning strategies adopted by students. Also, high degrees of 
congruence with planned learning and low degrees of task authenticity tended to be associated 
with surface learning strategies. Alkharusi (2013) concluded that students' perceptions of 

206 



Alkharusi, H. A., & Al-Hosni, S. (2015). Perceptions of classroom assessment tasks: An interplay of gender, subject area, and grade 
level. Cypriot Journal of Educational Sciences. 10(3), 205-217. doi: http://dx.doi.org/10.18844/cies.vlil.66 


assessment tasks could affect their learning approaches. Likewise, van Dinther, Dochy, Segers, 
and Braeken (2014) found that students' perceptions of assessment predicted student self- 
efficacy in competence-based education which in turn influenced student learning outcomes. 
Van Dinther et al. (2014) concluded that students' perceptions of assessment can be enhanced 
by requiring students to do real-life tasks and giving them informative feedback, which are likely 
to foster their self-efficacy. 

Another line of educational assessment research has examined students' perceptions of 
specific types of assessment. For instance, Watering, Gijbels, Dochy, and van der Rijt (2008) 
found that students perceived traditional assessments in terms of multiple choice and essay 
questions as assessing application of knowledge more than reproduction of knowledge. 
However, no direct relationship was found between students' perceptions of assessment and 
their assessment results. This contradicted the notion that an appropriate match between 
perceptions of assessment and demands of assessment could lead to better assessment results. 
Watering et al. (2008) concluded that the purposes of the assessment tasks and the cognitive 
processes to be used for the assessment tasks should be made clear to the students rather than 
giving students examples of the assessment tasks. This practice might help students build up an 
appropriate match between perceptions of assessment and demands of assessment. Likewise, 
Lindblom-Ylanne and Lonka (2001) found that students' perceptions of traditional assessment 
practices such as written examinations in advance medicine tended to be negative and affected 
their ways to study for them. Lindblom-Ylanne and Lonka (2001) concluded that educators 
should consider students' perceptions of the assessment practices and experiences of the 
learning environment as a basis for curriculum design. In contrast, lannone and Simpson (2013) 
found that students' perceptions of the traditional assessment in mathematics tended to be 
positive portraying them as being the best discriminator of their mathematical ability, lannone 
and Simpson (2013) concluded that attention should be given to the nature of the subject when 
considering students' perceptions of the assessment. 

In summary, the aforementioned studies reported the importance to give attention to the 
students' perceptions of the classroom assessment tasks in order to understand their 
motivational beliefs and achievement-related outcomes. The present study intended to extend 
previous research by questioning how do students' perceptions of the assessment tasks vary as 
a function gender, subject area, and grade level. This is because students' experiences with 
classroom assessment depend usually upon their classroom contextual features (Brookhart & 
Bronowicz, 2003). 


1.1 Purpose of the Study and Research Questions 

This study aimed at investigating students' perceptions of their classroom assessment tasks 
as a function of gender, grade level, and subject area. The study was guided by the following 
research questions: 

1. How do students perceive their classroom assessment tasks? 

2. How do perceptions of classroom assessment tasks differ as a function of student gender, 

grade level, subject area, and their interactions? 


2. Methods 

2.1 Participants 

The participants in this study were 2753 Omani students (1458 females and 1295 males) 
selected from public schools across all governorates in the Sultanate of Oman. They were 
selected from grade 10 (1291 students) and grade 11 (1462 students). Their ages ranged from 
14 to 19 years with an average of 16 and a standard deviation of 1.11. The following subjects 
were represented in the sample: Arabic language (27.5%), English language (9.9%), Islamic 
education (9.7%), mathematics (16.2%), science (22.2%), and social studies (14.5%). 
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2.2 Procedures 

Permission was requested from Ministry of Education and school principals to collect data 
from the students during a regular scheduled class meeting in Spring 2013 semester. The 
students were informed that a study about their perceptions of the classroom assessment tasks 
is being conducted. They were informed that they were not obligated to participate in the study, 
and if they wished to participate, their responses would remain confidential. They were also told 
that participation in the study would not influence their grades or relations with the teacher in 
any way. Students who wished to participate were asked to respond to a self-report 
questionnaire, which will be described in the next section of this study. The questionnaire was 
administered by assistant researchers during a scheduled class meeting. The administration took 
about one class period, and was preceded by a brief set of instructions about how to complete 
the questionnaire. 


2.3 Instrument 

The instrument used was a self-report questionnaire with two main sections: Basic 
information and perceptions of assessment tasks. The questionnaire items were subjected to a 
content validation process done by a panel of five experts in the areas of educational 
measurement and psychology from Sultan Qaboos University and Ministry of Education. They 
were asked to judge the clarity of wording and appropriateness of each item for the use with 
the targeted participants and its relevance to the construct being measured. Their feedback was 
used for refinement of the items. Internal consistency reliability was established using 
Cronbach's alpha. Following is a description of the two sections. 


2.3.1 Basic information 

The basic information of the questionnaire covered gender, age, grade level, and subject 
being considered in the class. 


2.3.2 Perceptions of assessment tasks 

This section of the questionnaire included 35 items from Dorman and Knightley’s (2006) 
Perceptions of Assessment Tasks Inventory (PATI). The items measure students' perceptions of 
assessment tasks in terms of congruence with planned learning (7 items; = .73; e.g., "I am 
assessed on what the teacher has taught me"), authenticity (7 items; = .75; e.g., "My 
assessment tasks in this class are meaningful"), student consultation (7 items; = .74; e.g., "I am 
asked about the types of assessment I would like to have in this class"), transparency (7 items; 
= .85; e.g., "I am told in advance when I am being assessed"), and diversity (7 items; = .63; e.g., 
"I am given a choice of assessment tasks"). Responses were obtained on a 5-point Likert scale 
ranging from 1 (strongly disagree) to 5 (strongly agree). 

Alkharusi (2013) tested the validity and reliability of the PATI for the use with Omani 
students. As reported by Alkharusi (2013), internal consistency coefficients for the measures of 
congruence with planned learning, authenticity, student consultation, transparency, and 
diversity were .71, .72, .65, .66, and .63 as indicated by Cronbach's alpha, respectively. The score 
reliabilities of the current sample seem comparable to those reported by Dorman and Knightley 
(2006) and Alkharusi (2015). Specifically, internal consistency coefficients in this study for the 
measures of congruence with planned learning, authenticity, student consultation, 
transparency, and diversity were .69, .66, .61, .74, and .60 as indicated by Cronbach's alpha, 
respectively. Each measure was constructed by averaging its corresponding items. 
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2.4 Data Analysis 

In relation to the aforementioned purpose of the study, the following statistical procedures 
were employed: 

1. Descriptive statistics in terms of means, standard deviations, frequencies, and 
percentages were computed to examine students' perceptions of the assessment tasks. 

2. A three-way multivariate analysis of variance (MANOVA) was used to examine 
differences in students' perceptions of the assessment tasks with respect to student 
gender, grade level, subject, gender by grade level, gender by subject, grade level by 
subject, and gender by grade level by subject. There were no violation in the data with 
respect to the assumptions of normality, homogeneity of variance-covariance matrices, 
and multicollinearity. 


3. Results 

3.1 Descriptive Analysis 

Table 1 presents descriptive statistics for students' perceptions of the classroom assessment 
tasks. As shown in Table 1, on average, the students tended to hold positive perceptions of their 
classroom assessment tasks in terms of congruence with planned learning, authenticity, student 
consultation, transparency, and diversity. More than 80% of the students perceived their 
classroom assessment tasks as having high or very high degree of congruence with the 
classroom instruction and transparency. About 80% of the students perceived their classroom 
assessment tasks as having high or very high degree of authenticity. Nearly half of the students 
perceived that they have been consulted regarding the assessment tasks with a high or very high 
degree and that there was high or very high degree of diversity in the assessment tasks. 


Table 1. Descriptive statistics for students' perceptions of the classroom assessment tasks (N = 2753) 


Scale value 


Perceptions of assessment 
tasks 

1.00- 

1.79 

Very 

low 

1.80- 

2.59 

Low 

2.60-3.39 

Moderate 

3.40-4.19 

High 

4.20-5.00 

Very high 

M 

SD 

f(%) 

f(%) 

f(%) 

f(%) 

f(%) 

Congruence with planned 

7(0.3) 

86 (3.1) 

363 

1372 

925 (33.6) 

3.92 

.60 

learning 



(13.2) 

(49.8) 




Authenticity 

7(0.3) 

106 (3.9) 

449 

1472 

719 (26.1) 

3.81 

.62 




(16.3) 

(53.5) 




Student consultation 

25 (0.9) 

311 

919 

1226 

272 (9.9) 

3.40 

.64 



(11.3) 

(33.4) 

(44.5) 




Transparency 

10 (0.4) 

70 (2.5) 

338 

1222 

1113 

4.00 

.63 




(12.3) 

(44.4) 

(40.4) 



Diversity 

36 (1.3) 

330 

953 

1202 

232 (8.4) 

3.36 

.64 



(12.0) 

(34.6) 

(43.7) 





3.2 Multivariate Analysis of Variance 

Table 2 presents means and standard deviations of students' perceptions of assessment tasks 
with respect to gender, grade level, and subject. As presented in Table 2, it seems that there 
were differences in students' perceptions of the classroom assessment tasks as a function of 
gender, grade level, and subject. A 3-way MANOVA was used to examine these differences. 
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Table 3 summarizes results of the 3-way MANOVA about differences in the students' 
perceptions of the assessment tasks with respect to gender, grade level, subject, and their 
interactions. As shown in Table 3, there were statistically significant multivariate main and 
interaction effects for gender, grade level, and subject on the students' perceptions of the 
assessment tasks. The 3-way interaction effect for gender, grade level, and subject explained 
0.4% of the variance in the students' perceptions of the classroom assessment tasks. 

Table 2. Means and standard deviations of students' perceptions of assessment tasks with respect to 

gender, grade level, and subject 

Perceptions of assessment tasks 


Variable 

Congruence 

M (SD) 

Authenticity 

M (SD) 

Consultation 

M (SD) 

Transparency 

M (SD) 

Diversity 

M (SD) 

Gender 

Male 

3.81 (.02) 

3.70 (.02) 

3.35 (.02) 

3.81 (.02) 

3.34 

(.02) 

Female 

4.07 (.02) 

3.97 (.02) 

3.44 (.02) 

4.22 (.02) 

3.39 

(.02) 

Grade level 

Grade 10 

3.98 (.02) 

3.89 (.02) 

3.47 (.02) 

4.05 (.02) 

3.40 

(.02) 

Grade 11 

3.90 (.02) 

3.77 (.02) 

3.33 (.02) 

3.98 (.02) 

3.33 

(.02) 

Subject 

Arabic language 

3.98 (.02) 

3.82 (.02) 

3.49 (.02) 

4.02 (.02) 

3.41 

(.02) 

English language 

3.79 (.04) 

3.76 (.04) 

3.35 (.04) 

3.90 (.04) 

3.39 

(.04) 

Islamic education 

4.15 (.04) 

4.00 (.04) 

3.42 (.04) 

4.16 (.04) 

3.35 

(.04) 

Mathematics 

3.94 (.03) 

3.79 (.03) 

3.45 (.03) 

4.02 (.03) 

3.42 

(.03) 

Science 

3.75 (.02) 

3.71 (.03) 

3.26 (.03) 

3.89 (.03) 

3.26 

(.03) 

Social studies 

4.05 (.03) 

3.93 (.03) 

3.40 (.03) 

4.10 (.03) 

3.38 

(.03) 


Table 3. Results of the 3-way MANOVA about differences in students' perceptions of the assessment tasks 
with respect to gender, grade level, subject, and their interactions 


Variable 

Wilks'Lambda 

F 

Hypothesis df 

Error df 

Gender 

.90 

62.29* 

5 

2725 

Grade level 

.99 

6.65* 

5 

2725 

Subject 

.93 

7.51* 

25 

10124.43 

Gender x Grade level 

.99 

4.65* 

5 

2725 

Gender x Subject 

.97 

3.25 

25 

10124.43 

Grade level x Subject 

.98 

2.36* 

25 

10124.43 

Gender x Grade level x Subject 

.98 

2.31* 

25 

10124.43 


*p < .001 


Using Bonferroni adjustment for type one error rate at a = .01, the univariate analysis showed 
statistically significant 3-way interaction effects for gender, grade level, and subject on 
congruence with planned learning; F(5, 2729) = 3.32, p = .005, partial if" =.006; and 
transparency; F(5, 2729) = 6.46, p = .002, partial if 1 =.007. There were no statistically significant 
3-way interaction effects for gender, grade level, and subject on authenticity, student 
consultation, and diversity. Figure 1 displays the interaction effect between subject and grade 
level on congruence for male students. As displayed in Figure 1, grade 11 male students tended 
to hold more positive perceptions of the assessment tasks in Islamic education as being 
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congruent with the classroom instruction than grade 10 male students. On the contrary, grade 
10 male students tended to hold more positive perceptions of the assessment tasks in Arabic 
language, mathematics, science, and social studies as being congruent with the classroom 
instruction than grade 11 male students. There were no differences between grade 10 male 
students and grade 11 male students on the perceptions of the assessment tasks in English 
language as being congruent with the classroom instruction. Figure 2 displays the interaction 
effect between subject and grade level on congruence for female students. As displayed in 
Figure 2, grade 10 female students tended to hold more positive perceptions of the assessment 
tasks as being congruent with the classroom instruction than grade 11 female students across all 
subjects. 



Figure 1. Interaction of subject by grade level for males on congruence 



Grade 

level 

- 10.00 

11.00 


Figure 2. Interaction of subject by grade level for females on congruence 


Figure 3 displays the interaction effect between subject and grade level on transparency for 
male students. As displayed in Figure 3, grade 11 male students tended to hold more positive 
perceptions of the assessment tasks in terms of transparency in Islamic education and English 
language than grade 10 male students. On the contrary, grade 10 male students tended to hold 
more positive perceptions of the assessment tasks in terms of transparency in science and social 
studies than grade 11 male students. There were no differences between grade 10 male 
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students and grade 11 male students on the perceptions of the assessment tasks in terms of 
transparency in Arabic language and mathematics. Figure 4 displays the interaction effect 
between subject and grade level on transparency for female students. As displayed in Figure 4, 
grade 10 female students tended to hold more positive perceptions of the assessment tasks in 
terms of transparency than grade 11 female students across all subjects. 



Subject 


Figure 3. Interaction of subject by grade level for males on transparency 


V) 

C 

(0 

CD 


Subject 



Grade 

level 

— 10.00 
11.00 


Figure 4. Interaction of subject by grade level for females on transparency 


The univariate analysis also showed statistically significant interaction effects for gender and 
grade level on authenticity; F( 1, 2729) = 6.95, p = .008, partial rj 2 =.003; and student 
consultation; F(l, 2729) = 13.00, p = .000, partial if 2 =.005. There were no statistically significant 
interaction effects for gender and grade level on diversity. Figure 5 displays the interaction 
effect between gender and grade level on authenticity. As displayed in Figure 5, female students 
tended to hold more positive perceptions of the assessment tasks in terms of authenticity than 
male students across all grade levels. Figure 6 displays the interaction effect between gender 
and grade level on student consultation. As displayed in Figure 6, female students tended to 
hold more positive perceptions of the assessment tasks in terms of student consultation than 
male students in grade 10. There was no difference between males and females in grade 11 with 
respect to the perceptions of the assessment tasks in terms of student consultation. 
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Gender 

-male 

-female 


Figure 5. Interaction of gender by grade level on authenticity 



Figure 6. Interaction of gender by grade level on student consultation 

Further, the univariate analysis showed statistically significant interaction effects for gender 
and subject on student consultation; F(5, 2729) = 3.31, p = .006, partial tf 2 =. 006; and diversity; 
F(5, 2729) = 3.91, p = .002, partial r/ 2 =. 007. There were no statistically significant interaction 
effects for gender and subject on authenticity and transparency. Figure 7 displays the 
interaction effect between gender and subject on student consultation. As displayed in Figure 7, 
female students tended to hold more positive perceptions of the assessment tasks in terms of 
student consultation than male students across all subjects. Figure 8 displays the interaction 
effect between gender and subject on diversity. As displayed in Figure 8, female students 
tended to hold more positive perceptions of the assessment tasks in terms of diversity than 
male students in Islamic education, Arabic language, and mathematics. On the contrary, male 
students tended to hold more positive perceptions of the assessment tasks in terms of diversity 
than female students in English language and social studies. There was no difference between 
males and females with respect to the perceptions of the assessment tasks in terms of diversity 
in science. 
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Gender 

- male 

-female 


Figure 7. Interaction of gender by subject on student consultation 



Subject 


Gender 

- male 

- female 


Figure 8. Interaction of gender by subject on diversity 


In addition, the univariate analysis showed statistically significant interaction effects for grade 
level and subject on authenticity; F(5, 2729) = 3.98, p = .001, partial p 2 =.007; and diversity; F(5, 
2729) = 3.31, p = .006, partial if 2 =.006. There were no statistically significant interaction effects 
for grade level and subject on congruence and student consultation. Figures 9 and 10 display the 
interaction effects between grade level and subject on authenticity and diversity, respectively. 
As displayed in both Figures 9 and 10, grade 11 students tended to hold more positive 
perceptions of the assessment tasks in terms of authenticity and diversity than grade 10 
students in Islamic education. On the contrary, grade 10 students tended to hold more positive 
perceptions of the assessment tasks in terms of authenticity and diversity than grade 11 
students in all subjects except Islamic education. 
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Grade 

level 

- 10.00 

- 11.00 


Subject 


Figure 9. Interaction of grade level by subject on authenticity 



Subject 

Figure 10. Interaction of grade level by subject on diversity 


4. Discussion and Conclusion 

A central aim of the current study was to examine students' perceptions of the assessment 
tasks as a function of gender, subject area, and grade level. The results demonstrated that 
students tended to hold positive perceptions of their classroom assessment tasks in terms of 
congruence with planned learning, authenticity, student consultation, transparency, and 
diversity. There were statistically significant 3-way interaction effects for gender, subject area, 
and grade level on congruence with planned learning and transparency. Also, there were 
statistically significant 2-way interaction effects for gender and grade level on authenticity and 
student consultation. Further, there were statistically significant 2-way interaction effects for 
gender and subject area on student consultation and diversity. These results lead to a 
conclusion that students differ in their perceptions of the assessment tasks due the nature of 
the classroom assessment activities driven by the subject area and grade levels. 

The results of the present study add support to the findings of previous studies concerning 
univariate differences in students' perceptions of assessment as a function of gender (e.g., 
Dhindsa et al., 2007; Gao, 2012), grade level (e.g., Dhindsa et al., 2007) and subject area (e.g., 
lannone & Simpson, 2013). However, they point to the complexity of the relationship between 
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students' perceptions of assessment and classroom contextual features. There is a need for 
special attention to the nature of class gender, subject area, and grade level when considering 
conditions for classroom assessment to steer student motivational beliefs and learning 
strategies. The current study uncovered interesting interactions in students' perceptions of the 
assessment tasks. It will be useful to supplement the quantitative investigation with a qualitative 
inquiry to uncover the meanings of these interactions. 

The present study adds support to the value of incorporating students' perceptions of the 
classroom assessment tasks in order to understand the consequential validity of the assessment 
process. The unique findings of interactions between gender, subject area, and grade level 
deserve additional attention by teachers and policy makers regarding the design of classroom 
assessment tasks and professional training programs for teachers. The present findings imply 
that perceptions of the classroom assessment tasks might be directly related to the nature of 
content of the subject area within a specific grade level as well as the overall classroom 
atmosphere which varies by gender of the class. This situation suggests the necessity to tailor 
classroom assessments to meet the requirements of the subject areas and grade levels and to 
take into consideration ability expectations of the class. 

Despite the fact that the educational assessment system in the Sultanate of Oman is centrally 
regulated for all public schools by the Ministry of Education, teachers tend to vary in their 
practices of the assessment regulations which in turn might influence students' perceptions of 
the assessment. It is natural, however, that teachers attempt to accommodate the educational 
assessment policy regulated by the Ministry to the specific needs of the students and classroom 
curriculum. Yet, professional development programs are needed to increase teachers' 
awareness of the consequences of their classroom assessment practices on students. 

Although students' perceptions of the classroom assessment is of critical importance for 
understanding the impact of assessment practices on student learning and motivation, the 
reliance on self-report surveys is a limitation of the study. It would be optimal to utilize multiple 
methods in future research to examine the extent to which students' perceptions reflect actual 
features of the classroom assessment. Also, future research should consider more grade levels 
to enhance generalizability of the results. 
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